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Overview 






• Introduction. 

• Multi-sensor triangulation. 

• Multi-primitive triangulation: 

- Points. 

- Linear features. 

- Aerial features. 

• Experimental results. 

• Conclusions and future outlook. 
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Introduction 

• There is a tremendous increase in data acquisition 
systems, which are available for the mapping 
community: 

- Photogrammetric systems: 

• High resolution imaging satellites. 

• Metric analog frame cameras. 

• Metric digital frame cameras. 

• Metric digital line cameras. 

• Medium-format digital frame cameras. 

- LIDAR systems. 

- GPS/INS navigation units. 

• These systems provide complementary information. 



• We need to provide an integrating environment of 
Dp ^ese sensors: Multi-Sensor Triangulation (MST). 
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Photogrammetric Systems 
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Frame Cameras 





LIDAR Systems 




ALS 40 (Leica Geosystems) 
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Point-Based Triangulation 
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Line-Based Triangulation 




Photogrammetry : 

Direct measurement of intermediate points on images 
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Line-Based Triangulation 


LIDAR: 

Plane fitting & intersection 



manual identification of LIDAR 
patches with the aid of imagery 
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Line-Based Triangulation 


LIDAR: 

Manipulation of range and intensity images 
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Line-Based Triangulation 


<? 




Direct incorporation of LIDAR lines as control in the 

photogrammetric BA 
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Patch-Based Triangulation 






Direct incorporation of LIDAR patches as constraints in the 

photogrammetric BA 




P(X l ,Y l ,Z l ) 


Photogrammetric (A,BfC points) and LIDAR surface patches 
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Patch-Based Triangulation 




Direct incorporation of LIDAR patches as constraints in the 

photogrammetric BA 
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Multi-Sensor Triangulation (MST) 

• Developed an integrated triangulation system. 

- Multi-sensor: Satellite imagery, aerial imagery, LIDAR 
and GPS/INS. 

- Multi-primitive: distinct points, linear features, and aerial 
features. 


• Advantages: 

- Takes an advantage of the extended coverage of imaging 
satellites. 


- Takes an advantage of the high geometric resolution of 
aerial imaging systems. 

- Utilizes sparse frame imagery to improve the weak 
geometry of imaging satellites while reducing ground 
control point requirements. 



DPR (jUses LIDAR data for photogrammetric geo-referencing. 
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MST : Experimental Results 


DSS: 

Expected accuracy: 

plani metric: 0.25m 
vertical: 0.74m 
spatial: 0.78m 
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MST : Experimental Results 




Upper Block 
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MST : Experimental Results 




Middle Block 




DSS: Middle Block 
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Middle LIDAR Scan 
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MST : Experimental Results 


Lower Block 



DSS: Lower Block 
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Lower LIDAR Scan 
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Stereo-IKONOS with GCP Layout 




DPRG 


IKONOS scenes and GCP layout over Daejeon, Korea 
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MST : Experimental Results 
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Examples of Tie Points 
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MST : Experimental Results 
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Examples of Tie / Control Lines 
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MST : Experimental Results 
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Example of a Control Patch 
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No Ground Control Points 
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# GCP 

# Frames 

GPS / LIN / 
PATCH 

/V 

(mm) 

RMSE (m) 


X 

Y 

Z 

Total 

0 

0 

NONE 

N/A 

N/A 

N/A 

N/A 

N/A 

18 

NONE 

N/A 

N/A 

N/A 

N/A 

N/A 

LIN 

0.005 

2.105 

1.370 

1.757 

3.065 

PATCH 

0.004 

3.582 

3.394 

2.207 

5.406 

GPS 

0.006 

2.109 

1.048 

1.963 

3.066 

GPS + LIN 

0.005 

2.116 

1.358 

1.803 

3.093 

GPS + PATCH 

0.004 

2.374 

2.580 

2.294 

4.190 


138 Control Lines & 139 Control Patches 
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Configuration of 5 GCP 


OCRs for IKONOS 
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5 Ground Control Points 


<? 




# GCP 

# Frames 

GPS / LIN / 
PATCH 

/V 

(mm) 

RMSE (m) 


X 

Y 

Z 

Total 

5 

0 

NONE 

N/A 

N/A 

N/A 

N/A 

N/A 

18 

NONE 

0.006 

1.907 

1.084 

3.7474 

4.342 

LIN 

0.005 

1.786 

1.115 

1.717 

2.716 

PATCH 

0.004 

1.670 

1.009 

1.759 

2.628 

GPS 

0.007 

1.805 

1.024 

1.770 

2.727 

GPS + LIN 

0.005 

1.733 

1.112 

1.717 

2.681 

GPS + PATCH 

0.004 

1.647 

1.008 

1.786 

2.631 


138 Control Lines & 139 Control Patches 
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Configuration of 7 GCP 


GCPs for (KONOS 
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7 Ground Control Points 
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# GCP 

# Frames 

GPS / LIN / 
PATCH 

/V 

(mm) 

RMSE (m) 


X 

Y 

Z 

Total 

7 

0 

NONE 

0.005 

1.442 

1.608 

3.290 

3.936 

18 

NONE 

0.006 

1.568 

1.029 

2.392 

3.039 

LIN 

0.005 

1.738 

1.130 

1.722 

2.696 

PATCH 

0.004 

1.516 

1.025 

1.774 

2.549 

GPS 

0.007 

1.657 

1.025 

1.747 

2.618 

GPS + LIN 

0.005 

1.783 

1.132 

1.724 

2.726 

GPS + PATCH 

0.004 

1.578 

1.024 

1.792 

2.598 


138 Control Lines & 139 Control Patches 
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Configuration of 40 GCP 


GCPafor IKONOS 
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40 Ground Control Points 
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# GCP 

# Frames 

GPS / LIN / 
PATCH 

/V 

(mm) 

RMSE (m) 


X 

Y 

Z 

Total 

40 

0 

NONE 

0.011 

1.092 

0.870 

1.450 

2.013 

18 

NONE 

0.008 

1.129 

0.863 

1.528 

2.087 

LIN 

0.006 

1.173 

0.921 

1.495 

2.112 

PATCH 

0.004 

1.110 

0.845 

1.475 

2.030 

GPS 

0.008 

1.122 

0.859 

1.563 

2.107 

GPS + LIN 

0.006 

1.143 

0.934 

1.498 

2.103 

GPS + PATCH 

0.004 

1.095 

0.846 

1.478 

2.026 


138 Control Lines & 139 Control Patches 
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MST : Experimental Results 
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MST : Experimental Results 
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DPR 


MST : Experimental Results 
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Original Image 
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Ortho-Photo Generation 
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True Ortho-Photo Generation 
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MST : Experimental Results 


Generated Ortho-photo 


Differential Rectification 
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MST : Experimental Results 


Generated Ortho-photo 


True Ortho-photo 
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Concluding Remarks 






• The introduced methodologies are successful in: 

- Using LIDAR features for photogrammetric geo- 
referencing. 

• Line-based and patch-based photogrammetric geo-referencing 
using control derived from LIDAR data. 

- Delivering a geo-referenced imagery of the same 
quality as point-based geo-referencing procedures. 

- Taking advantage of the synergistic characteristics of 
spatial data acquisition systems. 


• The triangulation output can be used for the 
generation of 3-D perspective views. 
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Recommendations for Future Work 






• Automated segmentation of LIDAR data to extract 
the patches and linear features. 

• More investigation into using the outcome from 
the geo-referencing procedure for the verification 
of the system calibration. 

• Utilize the raw LIDAR measurements in the 
patch-based photogrammetric geo-referencing. 

- Such a utilization will allow for LIDAR system 
calibration. 

• Quality assurance and quality control procedures 
for LIDAR data. 
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3-D Perspective View 
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